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Abstract 

It has been shown that the heating, ventilation, and air conditioning (HVAC) 
systems of commercial buildings can offer ancillary services to power sys¬ 
tems without loss of comfort. In this paper, we propose a new control frame¬ 
work for reliable scheduling and provision of frequency reserves by aggrega¬ 
tions of commercial buildings. The framework incorporates energy-constrained 
frequency signals, which are adopted by several transmission system opera¬ 
tors for loads and storage devices. We use a hierarchical approach with three 
levels: (i) reserve capacities are allocated among buildings (e.g., on a daily 
basis) using techniques from robust optimization, (ii) a robust model predic¬ 
tive controller optimizes the HVAC system consumption typically every 30 
minutes, and (iii) a feedback controller adjusts the consumption to provide 
reserves in real time. We demonstrate how the framework can be used to esti¬ 
mate the reserve capacities in simulations with typical Swiss office buildings 
and different reserve product characteristics. Our results show that an aggre¬ 
gation of approximately 100 buildings suffices to meet the 5 MW minimum 
bid size of the Swiss reserve market. 


1 Introduction 

In many countries, large amounts of renewable energy sources (RES) are integrated 
in the power system and they increase the operational uncertainty due to their fluc¬ 
tuating nature. In a power system, supply and demand of electric power must be 
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balanced to keep frequency and voltage close to their nominal values. To main¬ 
tain this balance, transmission system operators (TSOs) procure ancillary services 
(AS), e.g., frequency and voltage control, traditionally from conventional genera¬ 
tors. With increasing RES shares, the need for AS is also increasing [1]. For this 
reason, there has been a recent interest in offering AS by flexible loads, which is 
known as demand response (DR). If properly aggregated, loads can provide AS 
without environmental impacts and, possibly, more efficiently and at a lower cost 
compared to generators [2]. 

Loads with thermal storage are suitable for DR because their consumption can 
be shifted in time without impact on consumer comfort. A lot of research fo¬ 
cused on modeling, control, and estimation of large aggregations of thermostat¬ 
ically controlled loads (TCLs), i.e., small residential loads such as refrigerators, 
air conditioners, space and water heaters [3-7]. The heating, ventilation, and air 
conditioning (HVAC) systems of commercial buildings are also interesting for DR 
because they are large consumers with high thermal inertia, and they usually in¬ 
clude a building automation and communication system that facilitates DR imple¬ 
mentation [8]. Recently, DR applications with commercial buildings has been the 
topic of several papers some of which are summarized below. The role of infor¬ 
mation systems and automated model-based control for energy efficiency and DR 
was discussed in [9]. Commercial HVAC systems are typically complex with many 
control variables and cascaded loops, and thus low-order models are used for con¬ 
trol purposes [10-12]. Research on DR with commercial buildings has focused 
mainly on “slow” services. For example, [13-16] proposed optimization-based ap¬ 
proaches and model predictive control (MFC) for peak shedding or load shifting to 
minimize energy costs. 

This paper is concerned with frequency control with commercial buildings, 
in particular secondary frequency control (SFC), which is also known as auto¬ 
matic generation control (AGC), load frequency control (LFC), automatic fre¬ 
quency restoration reserve (FRR), or regulation service. Recently, some authors 
have considered either scheduling or provision of “fast” AS from commercial 
buildings including SFC reserves. Ref. [17] experimentally investigated the fea¬ 
sibility of offering up and down regulation products with university campus build¬ 
ings, and identified baseline prediction and latency as potential obstacles for im¬ 
plementation. The authors of [18, 19] investigated SFC via fan power control in 
buildings with variable air volume (VAV) systems. Based on simulations, the au¬ 
thors found that up to 15% of a building’s fan power can be offered as reserves 
without significant loss of comfort, if the SFC signal is within the frequency band 
/ G [1/(10 min), 1/(4 sec)]. In [20], a control approach similar to that of [18,19] 
was experimentally validated in a real building, but without considering frequen¬ 
cies below 1/(10 min) to avoid effects on chiller power consumption. The follow¬ 
up work [21] included chiller control, which enlarged the frequency band of SFC 
signals to 1/(60 min). Ref. [22] investigated SFC by direct control of a heat pump’s 
(HP) compressor power using a variable speed drive motor in a water-based HVAC 
system. 
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Apart from accurate tracking of the SFC signal, a TSO needs guarantees that 
the reserve capacity of commercial buildings will be reliably available. Because 
the buildings are energy-constrained resources reserve scheduling is required, in 
particular if the SFC signal is not approximately zero-energy over short periods 
but can be biased towards one direction over long periods of time. A priori re¬ 
serve scheduling allows buildings to participate in markets for such reserve prod¬ 
ucts without compromising occupants’ comfort. Ref. [23] addressed this issue by 
developing an MPC-based method to quantify the flexibility of a commercial build¬ 
ing and a contractual framework to declare it to the utility. In this paper, we follow 
this line of research and consider robust reserve scheduling for aggregations of 
commercial buildings. 

The main contributions of this paper are threefold. First, we propose a new 
framework to estimate the SFC reserve capacity that can be reliably offered by an 
aggregation of commercial buildings considering weather conditions, occupancy, 
electricity prices, reserve payments, and comfort zone. The framework builds on a 
hierarchical control scheme with three levels, namely reserve scheduling and allo¬ 
cation, HVAC control, and reserve provision, and is based on robust optimization 
and MFC. The framework actively allocates reserves among aggregation’s build¬ 
ings based on their individual characteristics, which is expected to maximize the 
reserve potential in markets with typical requirements such as constant reserve 
capacity over a minimum duration and/or equal up- and down-reserve capacities. 
This is in contrast to [18,19,21] that estimated the capacity of a group of build¬ 
ings by simply scaling up the estimated capacity of a single building. Second, we 
propose new methods to estimate reserve capacities in case of energy-constrained 
frequency signals, a practice adopted by several TSOs for loads or storage devices, 
e.g., [24]. This is a significant advantage of our method compared to [23]. A 
relevant approach is taken in [25], where the reliable AS capacity from a commer¬ 
cial building is expressed as a function of the AS signal’s frequency. In contrast 
to [25], we are interested in the dependence of capacity on the integral of the SFC 
signal, i.e., on the signal’s bias directly, which we believe is the major limiting fac¬ 
tor when extracting reserves from energy-constrained resources. Third, we derive 
upper bounds on the untapped potential for SFC by different building types and for 
different reserve product characteristics such as duration, symmetry, and energy 
content. 

Although in some cases the SFC signal is approximately zero-energy, this is 
not generally true for all power systems. Ideally the bias of the SFC signal would 
be obtained from generators, e.g., through activation of tertiary control reserves or 
in a nearly real-time (e.g., 5 minute) market. However, nearly real-time markets 
do not exist in many control areas, and activation of tertiary control reserves is not 
always more economical than SFC reserves, because it highly depends on the the 
availability of cheap and flexible generators. In addition, with increasing RES pen¬ 
etration in power systems, the share of conventional generators in the production 
mix will decrease. Despite the improvements in forecasting techniques, the RES 
forecasts will never be perfect and biased forecast errors will translate into biased 
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SFC signals. With fewer controllable generators in the production mix, other re¬ 
sources will have to absorb these biases. For this reason, we believe that accounting 
for biases in the SFC signal will be very important in the future, possibly also in 
power systems where the SFC signal is today approximately zero-energy. To the 
authors’ best knowledge, this is the first time that methods are proposed to allow 
building aggregations to systematically schedule the reserve capacity that they can 
offer depending on how much bias exists in the SFC signal. 

This paper includes substantial extensions over our previous work [26], where 
some preliminary results were presented. A major improvement is related to mod¬ 
eling of the SFC reserve requests within the reserve scheduling and building control 
optimization problems. This paper considers also energy-constrained SFC signals 
apart from conventional unconstrained signals, whereas [26] considered only the 
latter. In the absence of energy constraints, the worst case reserve request is equal 
to either the up- or down-reserve capacity along the whole scheduling horizon. The 
reserve scheduling problem for this case was cast as a robust optimization problem 
with additive uncertainty in [26]. On the contrary, the determination of the worst 
case reserve request along the scheduling horizon is more involved with energy 
constraints due to time coupling. In this paper, we model an energy-constrained 
SFC signal as an uncertain variable that lives in a polyhedral uncertainty set and 
enters multiplicatively in the constraints. This allows us to reformulate the robust 
reserve scheduling problem into a deterministic tractable one. Another main ex¬ 
tension is related to the number and type of actuators that provide reserves in each 
building. In contrast to [26] that assumed either only heating or only cooling ac¬ 
tuators per building, the proposed formulations can be used to allocate reserves 
among different types of actuators within the same building. Therefore, the pro¬ 
posed formulations are more general than the ones in [26]. In addition, the simu¬ 
lation studies of this paper contain new material compared with [26]. We analyze 
recorded data of the Swiss SFC signal to illustrate that the SFC signal is not neces¬ 
sarily approximately zero-energy, but it can be significantly biased over periods of 
several hours. The performance of the control framework is then evaluated using 
an energy-constrained SFC signal, whereas the sensitivity analysis is performed 
considering signals with and without energy constraints. 

The rest of the paper is organized as follows: Section 2 summarizes some 
important aspects of power system SFC, Sections 3 and 4 introduce the modeling 
and conttol framework, the performance of the framework is demonstrated and 
evaluated in Section 5 in a simulation example, a sensitivity analysis is performed 
in Section 6, and Section 7 concludes the paper. 

2 Frequency Control in Power Systems 

Typically, a TSO controls frequency in three steps: primary, secondary and tertiary 
control. Primary control is a distributed, proportional controller that stabilizes the 
frequency after a disturbance. Secondary control is a centralized, proportional- 
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integral (PI) controller that restores the frequency to its nominal value and main¬ 
tains the desired exchanges between neighboring control areas. Tertiary control 
releases secondary control in case of large disturbances and is typically manually 
activated. 

Before continuing, we summarize some important aspects of scheduling and 
activation of SFC in power systems [27], which will be particularly relevant to the 
sensitivity analysis of Section 6. In most of Europe, SFC reserves are procured in 
a market setting, i.e., the generators bid their reserve capacity and price in weekly 
or daily auctions. The requirements of these auctions and the characteristics of 
the SFC reserve products vary from country to country. The minimum bid size 
is typically in the range [1,10] MW, e.g., 5 MW in Switzerland [28]. In many 
countries, only symmetric reserves, i.e., equal up- and down-reserve capacities, 
are allowed, whereas in other countries asymmetric reserves are also accepted. 
The reserve energy is requested from the generators via a signal sent by the TSO, 
typically every 2 — 4 seconds. There are two main activation rules: (a) the pro¬ 
rata activation, where the reserve energy is proportional to the capacity, and (b) the 
merit-order activation, where the reserves are requested based on the short term 
marginal costs of generators. The remuneration of reserve energy is also country 
dependent but it is typically separate from the reserve capacity remuneration. In 
some countries, e.g., in Switzerland, the reserve energy remuneration is coupled 
with the energy price in the spot market. As a final remark, note that we treat the 
SFC signal as uncertain in this paper because it is unknown at the time when the 
reserve capacities are determined. 

3 Modeling 

3.1 Building Aggregation 

We consider buildings with integrated room automation (IRA) systems, where 
heating, cooling, ventilation, blinds, and lighting are jointly controlled. IRA is 
typically used in office buildings because if provides high comfort while being en¬ 
ergy efficienf [29]. We represenf building thermal dynamics using a well-fesfed 
12* order mulfiple-inpuf-mulfiple-oufpuf bilinear model [11]. This model is based 
on fhe widespread fhermal resisfance-capacifance nefwork approach, and was val¬ 
idated againsf fhe well-known building simulafion soflware TRNSYS [11]. The 
model’s salisfacfory accuracy and ifs relafively low complexify make if suifable 
for MFC. A model similar fo fhe one considered here was used in an MFC imple- 
menfafion in a real building, and if was found fhaf if capfures fhe building fhermal 
dynamics well [10]. Furthermore, fhis model is flexibly cusfomizable and allows 
us fo perform large-scale simulafion sfudies wifh differenf represenfafive building 
fypes. 

The original model is bilinear befween inpufs u and disfurbances v (e.g., blind 
posifion and solar radiation), as well as befween inpufs and sfafes x (e.g., blind 
posifion and room femperafure). If fhe disfurbances are fixed, e.g., according fo 
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their predicted values, the bilinearities between u and v vanish and the system 
becomes time-varying. However, the bilinearities between x and u remain. For 
optimization purposes, sequential linear programming (SLP) can be applied by 
iteratively linearizing the bilinear x terms around the most recently calculated x 
trajectory and solving the resulting linear program (LP) until convergence [29]. 

If SLP is applied, the dynamics of a building b can be described by the linear 
time-varying model 

= A’^x’l + + R’^A4 , ( 1 ) 

where denotes the states at time step t (jix is the number of states), 

i.e., the room air temperature as well as the temperatures in different layers in the 
walls, floor, and ceiling (all measured in °C). u\ G denotes the IRA control 
inputs, namely heating and cooling power, ventilation, blind position, and lighting 
(Uu is the number of actuators). The heating and cooling are represented in the 
thermal model as heat fluxes affecting the system states and their units are W/m^, 
i.e., the heat fluxes are normalized by the floor area. The blind position is a num¬ 
ber between 0 (fully closed) and 1 (fully open). The lighting is also normalized 
by the floor area and measured in W/m^. G M”” denotes the disturbances that 
affect building’s states, e.g., ambient temperature in “C, solar radiation in W/m^, 
and internal heat gains by occupants and equipment in W/m^ (n^ is the number 
of disturbances). Au^ G M”’’ denotes the uncertain change in heat fluxes due to 
change in power consumption of the heating/cooling devices during reserve provi¬ 
sion, where is the number of actuators that are used for reserve provision. 

consists of the columns of that correspond to the heating/cooling actuators 
that provide reserves. The system’s output equation is = C^x^ + D\u\ + F^v\, 
where y\ G denotes the room temperature in °C and illuminance in lux. 

Denote by rgf the (electric) reserve capacity of actuator j of building h at time 
step t. Buildings can provide up-reserves by decreasing their consumption, and 
down-reserves by increasing it*. For now, we assume symmetric reserve capacities; 
asymmetric reserves will be discussed in Section 4. Since the HVAC control input 
for heating and cooling is defined as a heat flux, it is convenient to define also the 
“thermal” reserve capacity that has W/m^ units, can be obtained from 
by division with the coefficient of performance (COP). For notational convenience, 
we use the variable in the problem formulations and call it simply reserve 
capacity keeping in mind that it is actually the “thermal” reserve capacity. In the 
pro-rata activation case, the reserve energy is proportional to the reserve capacity 
based on a normalized SFC signal wt G [—1,1]. Note that the reserve capacity 
is a decision variable for the buildings, whereas the normalized SFC signal wt is 
uncertain. The primitive uncertainty wt results in an uncertain change in electric 

*The (electric) reserve capacity is the amount of SFC reserves that becomes available to the TSO 
[30]. In the context of frequency regulation, the term up-reserves denotes increase of a generator’s 
production or decrease of a load’s consumption to increase system frequency. Similarly, the term 
down-reserves denotes decrease of a generator’s production or increase of a load’s consumption to 
decrease system frequency. 
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power consumption of actuator j, = r^'lwt and the corresponding uncertain 

change in heat flux Au^’^ = 

Denote by G the predicted state of building b for time f + A: at 

time t. The predicted states at time t along a prediction horizon N are assembled 
in one vector as = [x^|^ ^t+k\t "• ^ Adopting the same 

notation for inputs and disturbances, the building dynamics along N can be written 
as = A^Xq + and = C^x^ + + F^v^, where 

the matrices A^, B^, E^, R^, C^, D^, and are of appropriate dimensions. The 
constraints on outputs (thermal comfort zone) and HVAC control inputs along N 
are 


< y? < y 




< 11? -c 




where 0 or 1 as entries. By substituting the dynamics in (2), 

the constraints can be written in terms of the control inputs and uncertainty as 
+ S^Au’l < Q^, where the matrices G^, S^, and are defined as 
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Gl = , si = C^R'’ , (4) 

= C'(A'x^ + E'v,') + F'v,' , (5) 

and Ijv is the N-dimensional identity matrix. Using G^, S^, and Q^, the HVAC 
input and comfort zone constraints along the prediction horizon can be represented 
compactly in the optimization problems of Section 4. 

We are interested in building aggregations for two main reasons. First, the 
reserve markets typically have requirements on the minimum size of the bidden 
reserve capacity, which is typically in the range [1,10] MW, as mentioned in Sec¬ 
tion 2. In most cases, individual commercial buildings cannot meet these minimum 
bid size requirements, so building aggregations are needed to enable participation 
in the reserve market. Even in markets with low minimum bid size requirements, 
e.g., in the range of a few hundred kWs, building aggregations would still be of 
interest in presence of other typical requirements, such as symmetry and minimum 
duration of the bidden reserve capacity. As shown in [26], aggregating buildings 
with different characteristics results in a larger total reserve capacity compared 
with the case where each building participates individually in the market. The sec¬ 
ond argument in favor of building aggregations is more practical. An aggregator’s 
job would be to determine the reserve capacity, bid it in the reserve market, and 
interact with the TSO during reserve activation and for the financial settlement. 
These tasks are very different to the normal activities of a building manager; there¬ 
fore, the aggregator could take over this burden that would otherwise be with the 
building manager. 
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Consider an aggregation of L buildings, i.e., b = {1... L}. Denote by = 
[xj Xj ... xf] € the vector containing all predicted states of all 

buildings along N. Using the same notation for inputs and disturbances, the in¬ 
put/output constraints of the aggregation can be written as Gu* + SA.Ut < Q, 
where G, S, and Q are block diagonal matrices with G^, S^, and on the di¬ 
agonal, respectively. Denoting by € [—1,1]^ the SFC signal along N, and by 
e ^'Ti'rLN ^ collection of the reserve capacities of all actuators and all buildings 
along N, the input/output constraints of the aggregation can be written as 


R = 


0 ... 0 

^ 2,1 -^ 2,2 Q • • • 0 

Rn,1 Rn,2 ■ '■ ■ Rn,N 


, Gui -I- SRrvt < Q , 


( 6 ) 


where Au* = R’Wt, R G ■^{nrLN)xN reserve capacity matrix, and Ri^k £ 
^nrL ^ column vector. The diagonal vectors of R are the actuators’ reserve 
capacities for every time step t, i.e., Rt^t = [ft ■ ■ ■ ■ This lower triangular 

structure satisfies causality and allows us to model the effect of past SFC signals. 
For example, Rt,t-i accounts for the signal at time f — 1 to determine the reserve 
at time t. However, to comply with today’s practice we fix R* ^ = 0 for i / A; in 
the following, i.e., the reserve energy depends only on the capacity and the current 
SFC signal. Thus, R is a block diagonal version of r^. 


3.2 Uncertain Frequency Signals 

3.2.1 Power Constraints (PC) 

In pro-rata activation [28], the reserves are requested by the TSO via a normalized 
frequency signal wt G [—1,1]. This box constraint represents the power constraints 
of the signal. The values wt = —I and wt = I indicate full activation of up- and 
down-reserves, respectively. The uncertainty set along N can be written as 


Wi = {wt G : ||wt||oo < 1 } . ( 7 ) 

3.2.2 Power and Energy Constraints (PEC) 

To facilitate the participation of energy-constrained resources (thermal loads and 
storages) in AS, the frequency signals can be distinguished by their energy content. 
A building aggregation could then choose the preferred product to offer reserves. 
Energy constraints can be cast as linear constraints on the mean value of the signal 
as 


-eT<y, 


t+T-1 

k=t 
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Wk < eT 


( 8 ) 




where e is the bias coefficient, T is the averaging period, and both are fixed by fhe 
TSO for a particular producf. Equation (8) implies fhaf fhe bias of the signal over 
T is bounded. If we stack (8) along N, we get the polyhedral constraint on the 
uncertainty A^wt < b^„, where is a matrix with entries —1, 0 or 1, and 
is a vector with entries eT. The power constraints (7) are still present, since the 
full reserve capacity could be requested anytime. Denote by Ijy the N-dimensional 
identity matrix, and by Iat the N-dimensional vector with ones. Defining A^ = 
[A^; Ijv; —Iat] and b^ = [b^^; Iat; Iat] ^ the uncerfainfy sef for PEC is 


W 2 = {wt G : A^Wi < b^} . (9) 

3.3 Other Sources of Uncertainty 

Apart from fhe SEC signal, in general, fhere are fwo ofher sources of uncertainly 
associaled wilh our problem: (a) wealher and occupancy uncertainlies, i.e., devia- 
lions from the predicted values, and (b) electricity and reserve price uncertainties. 
Eor simplicity, weather/occupancy uncertainties are not considered in this paper, 
i.e., the predictions are assumed to be perfect. There exist several approaches in the 
literature of building climate control to handle these uncertainties such as stochas¬ 
tic MPC with additive Gaussian noise [29], scenario-based MPC [31], or simply 
constraint tightening, which can be relatively easily integrated in our framework. 
We assume that the building aggregation acquires energy from the retail market, 
and since the utility company tariffs are typically constant over long periods, there 
is no electricity price uncertainty in our case. However, the situation is different 
for the reserve prices. Although the reserve bid price is selected by the aggregator, 
there is uncertainty involved because the bid might not be accepted in the auction. 
Incorporating this source of uncertainty requires modeling the market clearing pro¬ 
cess and is beyond the scope of this paper, but it may well constitute an interesting 
topic for future research. 

4 Control Framework 

4.1 Hierarchical Scheme 

In this section, we present the hierarchical control scheme for frequency reserve 
provision by commercial building aggregations, which is graphically shown in 
Pig. 1. Eevel 1 (Evl), the aggregator scheduling, is performed on a daily basis 
centrally by an aggregator. There are two conflicting objectives in the problem: 
(a) minimize energy consumption through energy efficient control, and (b) deviate 
from the energy-optimal solution to leave slack for reserve provision. The optimal 
tradeoff between these conflicting objectives depends on the monetary incentives 
for reserves, which we call capacity payments, and the cost of electricity. Evl de¬ 
termines the reserve capacity, and its allocation among buildings, which achieve 
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Figure 1: Overview of the proposed hierarchical control scheme. 


the optimal tradeoff while respecting occupants’ comfort in case the reserve is re¬ 
quested. The aggregator solves a robust optimization problem using building state 
measurements, prices of electricity and reserves, as well as predictions of weather 
and occupancy. We formulate the robust problem first for PC only and second for 
PEC. Reliable provision of frequency reserves is critical for power system security, 
and so TSOs typically require 100% availability of the reserve capacity [28]. For 
this reason, HVAC input constraints are truly hard constraints and robust optimiza¬ 
tion is a natural approach to follow. 

Level 2 (Lv2), the building HVAC control, is a robust MPC [32] that determines 
the energy optimal HVAC control inputs every 30 minutes locally at each building, 
and leaves enough slack for reserves. Level 3 (Lv3), the, frequency signal filtering 
and tracking, is a feedback controller that tracks the SFC signal by controlling 
the power consumption in real-time, e.g., every 10 seconds. In Fig. 1, signals and 
control actions with thick/solid curves are real-time, the ones with thin/solid curves 
are executed every 30 minutes, and the ones with dashed curves are executed once 
a day. 

4.2 Lvl: Aggregator Scheduling 

The aggregator’s goal is to determine the optimal amount of reserves R* to be 
offered in the market. Denote by c* G ^ electricity 

cost and reserve capacity payment vectors, respectively, where Ni is the prediction 
horizon. Note that efficiency facfors incorporafing acfuafors’ COP and building 
disfribufion sysfem losses are included in Ct and k^. Lvl can be casf as fhe robusf 
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LP 


(u*,R*) ;= argmin c^Uj — k^RlAfi (10a) 

s.t. max (Gui + SRwt) < Q (10b) 

wtGW 

MRl 7 Vi = 0, (10c) 

where W is the uncertainty set, i.e., W G {Wi,W2}. Equation (10b) requires 
that input and output constraints are satisfied even in the worst case of uncertainty 
realization. By appropriately selecting M in (10c), we can impose constant reserve 
capacities over a period of time and/or the block diagonal structure on R discussed 
in Section 3.1. The building dynamics in (10b) are decoupled among buildings; 
however, the coupling comes via (10c) and the objective function. 

Denote by Xq) the j'*’ row of any matrix or vector X. We derive the robust 
counterpart of (10) for PC and PEC. Consider the row of (10b) max^t (G(j)Ut+ 
S(j)Rwf) < Qq). The term SQ)R’Wt is a scalar and can be written as F(j)f, 
where f G is a column-wise vectorized version of R and F(j) = (IjVi C* 

G ^ where (g) is the Kronecker product. Thus, the j* row of 

(10b) is equivalent to 


4.2.1 Robust Counterpart for Power Constraints 

In the presence of PC only, the uncertainty set Wi is given by (7), i.e., is 
constrained in an oo-norm ball. In this case, we can maximize the left-hand side 
of (11) analytically using the dual of oo-norm, i.e., the 1-norm [33]. hollowing 
this procedure, the deterministic equivalent of (11) is G(j)Ut -|- ||F(j)f||i < Q(j). 
Repeating this procedure for all rows of (10b), the robust counterpart problem of 
(10) can be written as 

(u*,f*) := argmin — k^f (12a) 

s.t. G(j)Ut -h ||F(j)f||i < Q(j) Vj (12b) 

Mf = 0 , (12c) 

where k^ G and M are defined by k^f = k^R1 and Mr = MRljVj ■ 

Problem (12) is an EP, buf if grows quadrafically in Ni since we need Ni auxiliary 
variables and 2A^i additional consfrainfs for each uncerfain consfrainf (11) fo model 
fhe 1-norm. A similar reformulation for a general class of linear sysfems wifh 
reserve demands can be found in [34]. 

We now consider fhe case where eifher only heating or only cooling acfua- 
fors provide reserves in each building, which is likely in pracfice fo avoid energy 
dumping by simulfaneous heafing and cooling. Recall from (3), (4) fhaf S is a 
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block diagonal collection of = [C^R^; H^; —C^R^; —H^]. If only heating 
(cooling) actuators are used for reserve provision, then all entries of R^ are non¬ 
negative (non-positive). Additionally, all entries of and are non-negative by 
construction. Therefore, every row of S contains either only non-negative or only 
non-positive entries and, by construction, the same holds for all entries of i.e., 
A:) > 0 Vi, k] or [F(j)(i, A;) < 0 Vi, A:] Vj. Based on the definitions of F(j), 
f, and r*, and recalling that f is non-negative, ||F(j)f||i can be equivalently 
written as the linear term 

=Ef.', Eri. 

Y.7=i =iS(i)i*ri, 

where nei = UrLN'^ and | • |* denotes the element-wise absolute value operator. In 
this case, the more general formulation (12) can be simplified to the following LP 
that has the same size as (10), and so can be solved efficiently^. 

(u*, Fj) := argmin cj (14a) 
s.t. G(j)Ut + |S(j)|*rt < Qq-) Vj (14b) 

Mri = 0 . (14c) 


4.2.2 Robust Counterpart for Power and Energy Constraints 

With PEC, the uncertainty set W 2 is a polyhedron and duality theory can be applied 
to derive the robust counterpart problem [33, 35]. We write constraint (11) as an 
optimization problem over w* 


r^x (G(j)Ui-b w7F(j)f) < Qq) (15a) 

s.t. < bu, . (15b) 

By deriving the dual problem of (15) for all j, we obtain the following robust 
counterpart of (10) 


) := arg min W — f 

(16a) 

s.t. b^A^) -b G(j)U 4 - Q(j) < 0 Vj 

(16b) 

A7^i)=F(,-)f Vj 

(16c) 

\j) > 0 

(16d) 

Mr = 0 , 

(16e) 


^Note that (14) is a special case of (12), and it is equivalent to formulation (13)-(15) in our 
previous work [26]. 
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where A(j) is the vector of dual variables. Problem (16) is an LP, but its size 
grows quadratically in Ni. Although this dualization technique holds also for PC, 
we apply analytic maximization in that case since it results in fewer variables and 
constraints. 

Remark: Asymmetric reserves can be modeled defining R”'", w+ e 
for down- and R , G [—for up-reserves. In case of PC only, the 
uncertainty set remains a polyhedron and a tractable robust counterpart problem 
can be derived using analytic maximization. The reader is referred to [26] for 
detailed formulations. In case of PEC, the non-linear constraint = 0 is 

needed to ensure that up- and down- reserves are not requested simultaneously. 
Therefore, the uncertainty set is not a polyhedron any more and the dualization 
technique cannot be applied in this case to derive the robust counterpart problem. 

4.3 Lv2: Building HVAC Control 

Given the optimal reserve allocation from Lvl, in Lv2 the HVAC control inputs 
are determined every 30 minutes by the robust MPC with prediction horizon N 2 

Uj’*:=argmin (cj)'''uj (17a) 

s.t. max , (17b) 

where and R^’* are the parts of Ct and R*, respectively, that are relevant for 
building b. The first input of the optimal control sequence of (17) determines the 
Lv2 setpoint of the HVAC system for the next 30 minutes^, Problem (17) 

formulates an MPC with open-loop predictions, i.e., the optimization is performed 
explicitly over the control inputs u^. MPC with closed-loop predictions, i.e., opti¬ 
mization over affine policies of fhe uncerfainly, showed minor or zero performance 
improvemenf in fhis case, and so if is nol used. In fhe following, we derive fhe 
robusf counferparfs of (17) for PC and PEC. 

4.3.1 Robust Counterpart for Power Constraints 

In this case, the deterministic equivalent of (17) can be obtained by substituting 
(17b) with Vy, where is defined similarly to 

F(j) but for a single building, and f^’* is a column-wise vectorized version of R^’*. 
Note that f is fixed in Ev2, and the right-hand side of the inequality is a constant. 

^Although a consumption schedule is calculated in Lvl, the MPC of Lv2 can reduce the costs 
due to less uncertainty (recent reserve requests are known and better weather forecasts might be 
available) and, possibly, shorter optimization time steps. In case of plant-model mismatches, MPC 
additionally reduces constraint violations due to its closed-loop operation. The MPC schedule is 
the building’s baseline consumption, and is communicated to the aggregator. Since the baseline is a 
by-product of the formulation, baseline prediction methods that have proven to be hard [17] are not 
required. Furthermore, the predictive nature of MPC inherently accounts for rebound effects due to 
reserve provision when calculating future HVAC setpoints [9]. 
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4.3.2 Robust Counterpart for Power and Energy Constraints 


With PEC, the robust counterpart of (17) is 

:=argmin(c^)"^Uj^ (18a) 

s.t. + Gf < 0 Vj (18b) 

Vj, (18c) 

Af.)>OVj. (18d) 


Problem (18) is similar to (16), but there are two main differences: first, f^’* is 
fixed; and second, ^ and are time-varying. For a time step t in the averag¬ 
ing interval [ti,t 2 ] of length T, (8) can be written as —eT — Wp^t < Yl^k=t < 
eT — Wp^t, where Wp^t = '^k is known because the uncertainty up to f — 1 

is realized. Thus, the coupling constraint on {wt ,..., wt^) depends on the energy 
content of the SEC signal in the previous time steps of the averaging interval. 

4.4 Lv3: Frequency Signal Filtering and Tracking 

In Ev3, the HVAC consumption is controlled around for reserve provision. 

We consider water-based HVAC systems that are common in Europe, but the pro¬ 
posed reserve scheduling problem applies also to air-based systems [23]. The 
power consumption of water circulation pumps in water-based HVAC systems is 
typically small, and so we directly control the heating or cooling devices, e.g., heat 
pumps (HPs), to provide reserves. The desired power consumption of HP j of 
building b is 


U- 


6,j,Lv3 


b,7',Lv2 A 0,7 o,7,Lvz I o 
= + Wtr^ 


fid 


b,j,L\2 


bj,* 


(19) 


where is fixed from Evl. In case of asymmetric reserves, is equal to the 
down-reserve capacity if wt > 0, and equal to the up-reserve capacity if wt < 0. In 
a fast time scale, and depending on the HVAC system, the HP consumption can be 
controlled by modifying either the water temperature setpoint at condenser’s outlet 
or the refrigerant’s flow rate via valves. We rely on the second approach that was 
experimentally shown to be able to track fast reference signals, e.g., SEC signals, 
in [36]. The desired HP consumption can be tracked using a feedback PI 

controller. 

With PC only, the normalized reserve request wt sent from the TSO is the 
original SEC signal, whereas with PEC, wt is a filtered version of that signal. 
With reasonable modifications, the current operational paradigm at the TSO side 
can integrate multiple SEC signals with different energy contents. In the current 
paradigm, there is a single SEC signal that is the output of a PI controller with 
the area control error (ACE) as input. In the new paradigm, the TSO provides a 
number of reserve products and each reserve provider chooses the product to offer 
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its reserve capacity. Assume that the total reserve request (original SFC signal) at 
time step t is wt- The TSO will decompose wt into the desired number of signals 
(e.g., using a filter bank) and will sent the appropriate components to the providers 
depending on the reserve product they offer reserves for. To simulate this process 
in this paper, we use a causal Chebyshev filter to get the energy-constrained signal 
Wt sent to the building aggregation, but other filters might also be used. Similar fil¬ 
tering approaches have been used in previous works on power system applications, 
e.g., [37]. Note that although wt is a filtered signal, it does not mean that its bias is 
zero but instead that its bias is bounded. The filter’s transfer function is 


H{z) 




( 20 ) 


where nf is the filter’s order, and at, hi are its coefficients that depend on the pass- 
band edge frequency /c. From a TSO perspective, nf and /c can be chosen such that 
the resulting low-frequency component (LF signal) and high-frequency component 
(HF signal) have the desired ramping rates and energy contents. In this paper, we 
fix nf = 3 since if showed good performance in preliminary simulafions. 

If is imporfanf fo clarify how fhe SFC signal filfering is faken info accounf in 
fhe higher levels of fhe confrol hierarchy. Recall fhaf fhe filfered signal is fracked 
every few seconds in Lv3, whereas fhe decisions in Lvl (reserve scheduling) and 
Lv2 (determination of optimal building sefpoinfs) are faken every 30 minutes. Due 
fo fhis time scale separation, fhe imporfanf informafion from fhe filfering of Lv3 
fhaf needs fo be conveyed fo Lvl and Lv2 is only fhe integral of fhe SFC signal 
over fhis period, i.e., fhe bias of fhe signal. This is needed for example in Lvl 
fo schedule fhe reserve capacities wifhouf violafing fhe buildings’ fhermal comfort 
consfrainfs. By formulating fhe energy consfrainf of fhe SFC signal as fhe linear 
inequalifies (8), we can direcfly accounf for fhe signal’s bias in fhe optimization 
problems of Lvl and Lv2 in a fracfable way. Nofe fhaf fhe bias coefficienfs e for 
differenf averaging periods T in (8) can be empirically obfained from fhe filler (20). 
To do so, one can simply apply fhe filter on hisforical dafa of SFC signals using 
differenf /c = 1/T. 

Due fo fhe robusf design, any admissible reserve request wt that satisfies (8) 
will nol lead fo comforl zone or inpul consfrainf violalions, provided fhaf Ihere 
is no significanl planl-model mismalch. The fracking qualify of wt depends on 
HP’s mechanical delays and dead-limes, ramping limifs, and minimum down-times 
and/or run-fimes. If such dynamics are significanl, fesfs similar fo fhe ones in 
[36] musl be performed fo idenlify upper limifs on fhe frequency conlenl of wt 
fhaf resull in good fracking by fhe HP. In fhis case, fhe building aggregation could 
form a coalilion wilh fasler resources, e.g., an aggregation of residenlial eleclric 
water heaters, exclude very high frequency componenfs of fhe SFC signal using an 
appropriate band-pass filter, and send fhem fo fhe fasler resources. Since fhe focus 
of fhis paper is on fhe robusf reserve scheduling and allocafion side, we assume 
fhaf such HP dynamics are negligible, i.e., fhe reference (and so fhe SFC 
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Table 1: Bias Coefficients (e) for the SFC Signal and its High-frequency Compo¬ 
nent (HF) for Different Averaging Periods (T) 


T 

1 h 

2h 

4h 

6h 

8h 

12 h 

SFC 2009 

1.000 

0.989 

0.952 

0.796 

0.592 

0.505 

HF 2009 

0.528 

0.467 

0.337 

0.273 

0.384 

0.229 

SFC 2012 

0.927 

0.781 

0.674 

0.624 

0.553 

0.448 

HF 2012 

0.382 

0.300 

0.317 

0.290 

0.237 

0.203 


signal) can be perfectly tracked in our simulations if the comfort zone and input 
constraints are satisfied. 

5 Performance of Control Framework 

5.1 Investigation Setup 

We investigate the performance of the proposed control framework in simulations 
with an aggregation of typical Swiss office buildings. We consider two HVAC 
systems: in system A, heating is performed via radiators with coefficient of per¬ 
formance (COP) equal to 3, whereas cooling with cooled ceilings (COP = 3.5); 
in system B, both heating and cooling are performed using thermally activated 
building systems (TABS) with COP = 3.4. We also differentiate between heavy 
(eh) or light (el) building envelope, high (wh) or low (wl) window area fraction, 
and high (gh) or low (gl) internal gains. In our simulations, we consider an ag¬ 
gregation of 6 large buildings (15000 m^ each) with the following characteristics: 
A1 = {A,eh,wh,gh}, A2 = {A,eh,wl,gl}, A3 = {A,el,wl,gl}, B1 = {B,eh,wh,gh}, 
B2 = {B,eh,wl,gl}, and B3 = {B,el,wl,gl}. Typical occupancy prohles were used, 
whereas weather data were provided by Meteoswiss (the Swiss federal office of 
meteorology and climatology). More information regarding the buildings can be 
found in [26,29]. Because of the thermal inertia, heating/cooling actuators can be 
used to provide frequency reserves. In buildings with the HVAC systems consid¬ 
ered here, the fresh air flow rate is usually kept constant because changes would 
be immediately realized by the occupants. For this reason, we do not use venti¬ 
lation for reserve provision. The temperature comfort zone during working hours 
is [21, 24] °C in winter and [22, 25] °C in summer, which is in accordance with the 
ASHRAE 55-2013 standard [38]. During non-working hours and weekends, the 
comfort zone is relaxed to [12, 35]°C in both seasons. The optimizations are per¬ 
formed with a time step of 30 minutes, which is the discretization step of building 
models (1), and the prediction horizons of Lvl and Lv2 are hxed to Ni = 96 
(2 days) and N 2 = 48 (1 day), respectively. We assume symmetric, daily reserves, 
i.e., constant reserve capacity over a day, and capacity payments 10% higher than 
the electricity price, i.e., k = 1.1c. 
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5.2 Parameters of Energy Constraints 

To apply energy constraints as in (8), we determine appropriate pairs of averaging 
period and bias coefficient (T, e) based on the historical normalized SFC signals 
Wk € [—1,1] from the Swiss control area for 2009 and 2012. We consider six 
different averaging periods, T = {1, 2,4,6, 8,12} hours, and calculate six sets of 
filter parameters in (20), one for each of the pass-band edge frequencies fc = 1/T. 
For each value of T, we filter the historical SFC signals using the corresponding 
filter (20) to get the HF signals for 2009 and 2012. For each of the four signals 
and for each value of T, we calculate e as the largest absolute mean value of the 
SFC or HF signal over any period T, i.e., e = max(|(l/T) • Yl"k=i'^k\)- The 
results are summarized in Table 1. Notice that the original SFC signals can be 
significantly biased over periods of several hours. Note also that the biases of 
the HF signals are significantly lower than those of the original SFC signals, and 
that the signals in 2012 are generally less biased than in 2009. This is because 
from March 2012 the ACE of Switzerland is netted with that of other European 
countries before generating the SEC signal. We use the HE signal of 2012 and 
select (T = 2 h, e = 0.3) for the simulations of this section, according to Table 1. 

5.3 Operation for Typical Weeks 

We present simulation results for typical weeks in winter and summer. In Eig. 2, 
we show a 4-hour extract of the SEC, EE, and HE signals for a sample day, whereas 
in Eig. 3 we show the 2-hour moving averages of the signals for the whole day. 
Although the original SEC signal is mostly negative, its bias is absorbed by the EE 
signal, and so the HE signal is approximately zero-mean. The bias e of the SEC 
signal is larger than 0.3, whereas the energy-constrained HE signal has a bias less 
than 0.15. 

Eigure 4 shows the optimal total reserve capacity of the aggregation and its 
allocation among buildings for the winter week. The capacity is constant for each 
day and ranges from approximately 260 kW on Eriday to 380 kW on Saturday with 
an average weekly value of 313 kW. Note that the capacity is shifted among build¬ 
ings in a way that maximizes the total capacity of the aggregation. Interestingly, the 
buildings offer higher reserve capacities when they normally consume less power. 
Eor example, buildings with system A contribute mainly at night, whereas build¬ 
ings with system B offer more reserves during working hours, because they prefer 
to preheat at night. The scheduled total energy consumption of the aggregation 
is spread throughout the whole week to maximize the reserve potential. During 
the weekend, the buildings are not occupied and the comfort zone is larger, which 
results in higher reserve capacities compared to working days. 

The optimal operation of building A3 based on Ev2 and Ev3 is presented in 
Eigs. 5 and 6. Eigure 5 shows the HVAC system heating power and Eig. 6 the 
resulting temperature trajectories. The black-solid curves indicate the scheduled 
consumption and temperature by the MFC, whereas the grey-dashed curves corre- 
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Figure 2: A 4-hour extract of the original SFC signal, its low-frequency (LF), and 
its high-frequency (HF) components for a sample day. 



Figure 3: The moving averages of the signals of Fig. 2 for the whole sample day. 


spond to the final values after tracking the HF signal. The grey envelope shows 
the problem’s robust region, which is defined as fhe region of fhe fhermal comfort 
zone wifh fhe following property. If fhe femperafure is wifhin fhe robusf region 
af fime sfep t = 0, fhen for any SFC signal wifh fhe appropriafe energy confenf 
fhere exisfs a feasible confrol inpuf frajecfory fhaf salisfies fhe fhermal comforf and 
HVAC inpuf consfrainfs (fhe black-dashed curves in bofh figures) along fhe pre¬ 
diction horizon t £ [0, — 1]. In our simulations, fhe HVAC inpufs and room 

femperafure sfay always wifhin fhe robusf region. 

In summer, fhe reserve pofenfial from cooling acfuafors is also significanf. Dur¬ 
ing fhe considered week, fhe capacities range from approximafely 60 kW on Sun¬ 
day fo 420 kW on Safurday wifh an average weekly value of 323 kW. We observed 
a more uniform disfribufion of reserves among differenf buildings in summer, com¬ 
pared fo winfer, because cooled ceilings and TABS have similar fime consfanfs. 
Due fo space limifafions, plofs similar fo Figs. 4, 5 and 6 are omiffed. 

Based on our resulfs, fhe considered 6 buildings wifh floor area 15000 m^, 
average rated heating power 27 W/m^, and average rated cooling power 32 W/m^ 
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Figure 4: Optimal reserve allocation among buildings (winter week). 
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Figure 5: HVAC heating power for building A3 (winter week). 



Figure 6: Room temperature for building A3 (winter week). 


provide a reserve capacity equal to 313 kW and 323 kW on average in winter and 
summer, respectively. Using simple linear extrapolation, we find that the required 
minimum reserve capacity of 5 MW in Switzerland can be provided by 96 (similar) 
buildings in winter and 93 buildings in summer, i.e., approximately 100 buildings 
in both seasons. Note that this is only a rough estimate as: (a) it is based on 
the average reserve capacity values; and (b) the extrapolation might overestimate 
the required number of buildings to meet the 5 MW limit, because the larger the 
aggregation the more flexibility exists in allocating reserves among buildings. 

5.4 Effect on Energy Consumption 

To maximize the reserve potential, the buildings operate in a less energy efficient 
way. For example, during the considered winter week reserve provision resulted 
in a consumption 60% higher than that of energy efficient building control, i.e.. 
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an MPC with objective to minimize electricity cost without offering reserves. As 
shown in Fig. 5, in order to provide reserves in both directions, the buildings try 
to operate close to the middle of the heating/cooling device’s power range. This is 
in contrast to an energy efficient operation, where the power consumption would 
be as close as possible to the minimum value. However, the increase in energy 
consumption does not mean that the building control is suboptimal. For the given 
electricity price and capacity payment, this building operation minimizes the total 
cost defined as fhe sum of elecfricify cosf and reserve profif. 

If is imporfanf fo nofe fhaf fhe 60% consumption increase is in comparison 
wifh an MPC-based energy efficienf building confrol. However, mosf buildings to¬ 
day operafe wifh supervisory rule-based confrollers, i.e., nof opfimal confrollers. 
Therefore, if fhe proposed mefhods are applied to such buildings, fhe observed in¬ 
crease in consumpfion is expecfed to be less fhan fhe reported value. Allhough 
energy efficiency is usually fhe goal in building confrol, increasing fhe energy con¬ 
sumpfion is nof necessarily a drawback if fhis helps accommodate more RES in 
fhe power system, and al fhe same time fhe addifional elecfric energy is slored as 
fhermal energy in fhe buildings. 

5.5 Discussion on Imperfect Disturbance Predictions 

As menlioned in Secfion 3.3, fhe formulalions and simulations in fhis paper as¬ 
sumed perfecf wealher and occupancy predictions. The robusl formulalion guaran¬ 
tees satisfaction of fhe HVAC and comfort consfrainls for any admissible reserve 
requesf and perfecf wealher and occupancy predictions, bul if cannol provide mafh- 
emalical guarantees on fhe worsf case lemperalure devialions in case of imperfecl 
prediclions. Empirical guarantees could be provided by Monfe Carlo simulalions: 
(i) schedule fhe reserve capacifies using imperfecl dislurbance prediclions; (ii) sim¬ 
ulate fhe building operation under dislurbance uncerfainly, i.e., fhe wealher and oc¬ 
cupancy realizations are differenl fo fhe prediclions; and (iii) analyze fhe resulfs fo 
keep Irack of fhe number and magnilude of lemperalure deviations. Allernalively, 
probabilistic guaranlees could be oblained by modeling fhe wealher and occupancy 
uncerfainly via scenarios and Ihen robuslifying againsf fhe reserve uncertainly sep¬ 
arately for each scenario. This is an exciling research direction for fulure work. 

However, some inluilion can be provided wilhoul following any of fhe above 
Iwo approaches. Consider a building in energy efficienf operalion using a delermin- 
isfic MPC fhaf relies on an imperfecl wealher forecasl. As explained in Secfion 5.4, 
fhe building would operafe close fo fhe minimum power consumption, and fhus fhe 
lemperalure frajecfory would slay close fo one of fhe comforl zone boundaries. 
Now consider fhe same building operaled under reserve provision. As shown in 
Eig. 6, fhe building would operate closer fo fhe middle of fhe comforl zone fo max¬ 
imize fhe reserve capacity. Eor fhis reason, we expecf fhe reserve provision case 
fo resulf in smaller and perhaps less frequenl comforl zone violalions compared fo 
fhe energy efficienf confrol case, if fhe building is exposed fo fhe same wealher and 
occupancy uncertainly in bolh cases. 
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6 Sensitivity Analysis 

6.1 Capacity Payments 

As explained in Section 4.1, the proposed reserve scheduling methods identify 
the optimal tradeoff between minimizing energy consumption and leaving enough 
slack for reserve provision. The buildings would not deviate from the energy ef¬ 
ficient control and would not offer any reserves if the additional electricity cost 
occuning due to this deviation were higher than the reward received for the slack 
provided as reserve capacity. In principle, the amount of reserves depends on the 
relationship (ratio) between the capacity payment k, i.e., the remuneration for each 
kW of reserve capacity provided, and the electricity price c, i.e., the cost for each 
kWh of electricity consumed. In this Section, we investigate this relationship by 
running simulations, similar to the ones in Section 5.3, over 2-week periods in 
winter and summer and for various k/c ratios. The total reserve capacity for each 
case, i.e., the sum of the capacities of each day of the 2-week period, is presented 
in Fig. 7, where the left plot is for ratios k/c > 1 and the right plot is for ratios 
k/c < 1. These plots represent the aggregation’s bid curves because they commu¬ 
nicate how much capacity the aggregation is willing to bid in the reserve market 
depending on the payment it receives for each kW of the capacity. 

For k/c> I (left plot - Fig. 7 a) the simulations are performed for winter and 
summer with and without consideration of energy-constrained SFC signals: the 
black curves correspond to winter weeks (“win”) and the grey curves to summer 
weeks (“sum”), whereas the dashed curves are for PC and the solid curves for 
PEC. Our simulations show that with the same financial incentive and for both 
seasons, the buildings are willing to offer up to 10% more reserves compared with 
PC if energy constraints are considered. Note that the gap between PC and PEC 
is generally larger for lower k/c, particularly in winter. In winter, the capacity 
saturates at its maximum value at k/c = 1.1, whereas in summer it increases 
monotonically as the ratio increases up to 2. 

The analysis of Eig. 7a focused on k/c > 1, which is a necessary condition 
for reserve provision with PC. This observation was also made in our previous 
work [26]; however, here we provide an explanation by studying the structure of 
problem (12). If A; < c, the optimal solution is (u*,f*) = (u™",0), where u™" 
is the energy optimal scheduling. If A: = c, the optimal cost is 0 and any solution 
within the feasible range of f will be optimal. If A: > c, the optimal solution 
is (fmax -max where is the upper limit of f, and the optimal cost will be 
(c^ — < 0, i.e., the aggregation earns profit. The limit depends 

on input/output constraints, and so different solutions are obtained for different 
k/c > 1 ratios, as shown in Pig. 7a. In case of daily reserves, k/c > 1 need 
not to be satisfied point-wise throughout the whole day; instead, A:/c < 1 can be 
chosen during daytime, and k/c > 1 at night when electricity prices might be 
lower. Reserve provision will be triggered if ||A:||i/||c||i > 1, i.e., the capacity 
payment is on average higher than the electricity price. 
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On the other hand, with energy-constrained SFC signals (PEC) reserves can 
be provided also with ratios kjc < 1 throughout the whole day. It is easier to 
explain this with an example. Assume that the buildings have declared a capacity 
r[t) for day d. Assume also that up regulation (i.e., consumption decrease) is 
mainly requested during day d. If the signal is energy constrained, only a fraction 
of the worst case reserve energy r{t)dt will be requested as consumption 

decrease from the buildings. The rest part of ^ r{t)dt will be stored as thermal 
energy in the buildings and will reduce the required heating/cooling energy (and 
the respective costs) during day d+1. For this reason, the buildings are willing to 
provide reserves even if /c/c < 1. We present simulation results for PEC in winter 
and summer in Fig. 7b. The threshold ratio for reserve provision is A;/c = 0.32 for 
both winter and summer, and it depends on e and T. The capacity increases slowly 
in the ratio range [0.32 — 0.99], particularly in summer, and then it suddenly jumps 
to higher values as fe/c approaches to 1. No results are shown for PC in Fig. 7b 
because the capacity is zero for k/c < 1, as explained before. 

Fig. 7a shows that for unconstrained SFC signals (PC) a ratio k/c = 1.01, 
which means a capacity payment 1% higher than the electricity price, taps most of 
the reserve potential. In particular, further increasing the ratio up to the maximum 
considered value /c/c = 2 increases the reserves only by 8% in winter and no more 
than 18% in summer. Assuming an average electricity price of 146.6 CHF/MWh, 
which is the case for consumers who consume more than 60 MWh/year in Zurich, 
with a ratio k/c = 1.01 capacity payments around 148 CHF/MW/h are needed. 
This is significantly lower than the most expensive accepted bids, but approxi¬ 
mately 4 times higher than the average capacity payment in 2013 [39]. Fig. 7b 
shows that energy-constrained SFC signals can reduce the necessary capacity pay¬ 
ments down to 32% of the retail price {k/c = 0.32), but of course with a large 
reduction in the reserve capacity. Thus, reserves are actually costly for buildings 
already equipped with MPC for energy efficient (optimal) control, especially if the 
SFC signal is not energy-constrained. This is in contrast to TCFs with simple hys¬ 
teresis control based on a deadband, where reserves can be provided at a lower 
cost. However, note that our calculations are based on the prevailing case where 
the buildings acquire energy in the retail electricity market. In another market set¬ 
ting where the buildings acquired energy directly in the spot market, the buildings 
could offer reserves at more competitive prices because the retail electricity prices 
are typically significantly higher than the wholesale spot electricity prices. The 
analysis of this section provides intuition on the relationship between the amount 
of reserves from building aggregations and the capacity payments. In practice, esti¬ 
mating the capacity payment is a challenging task that needs to consider additional 
costs, e.g., due to device wear, but also the competition, i.e., the expected bid prices 
of generators and/or other load aggregations. 


22 


— PC, win-PEC, win - 

- - PC, sum — PEC, sum 

Total reserve 
capacity (MW) 

CD O 

O O O 

II.!! 




/ 







- - ' 


a 


1.2 1.4 1.6 1.8 

Capacity payment ratio (k/c) 



Figure 7: Bid curves of building aggregation in winter and summer. Left: for PC 
and PEC, and ratios fc/c > 1. Right: for PEC and ratios kjc < 1. 


6.2 Reserve Product Characteristics 

In this section, we fix fc/c = 1.1 and investigate the influence of important reserve 
product characteristics on reserve capacities. Eor PC, we consider reserves with 
daily or hourly duration, and symmetric or asymmetric capacities. Eor PEC, we 
investigate reserves with daily or hourly duration, as well as different (T, e) pairs, 
based on Table 1. We summarize simulation results with respect to the total reserve 
capacity for two weeks in winter and summer in Tables 2 and 3, where positive 
values denote up- and negative values down-reserves. 

Eor PC and symmetric products"^, hourly reserves increase capacities by 2.9% 
in winter and 3.3% in summer, compared to daily reserves. If asymmetric reserves 
are allowed, the aggregation provides significantly more down- than up-reserves 
in summer, whereas in winter no up-reserves are provided at all. Down-reserves 
(increasing power consumption) are preferable for buildings equipped with MPC 
for energy efficient control because the capacity can be offered without increased 
baseline consumption. The energy efficient control tries to stay as close as possible 
to the minimum power consumption of the heating/cooling device. In order to 
provide up-reserves (consumption decrease), a building needs to be able to reduce 
its consumption without violating occupant comfort. Therefore, the building must 
schedule its operation (baseline) at a power level higher than the energy optimal, 
which increases energy costs. On the other hand, down-reserves can be provided 
while operating at the energy efficient trajectory because the consumption can only 
increase will tracking the SEC signal. 

Compared to PC, PEC increase the reserves for all pairs (T, e) up to 3.8% in 
winter and 5.6% in summer. Eor given T and e, adopting hourly instead of daily 
reserves increases the capacities up to 2% in winter and 9.6% in summer. Note 
that the increase is higher for large T. Notice that shorter T are characterized 
by smaller eT products, and so constraint (8) on the uncertainty becomes tighter. 
Therefore, one would intuitively expect that decreasing T increases the reserve 
capacities monotonically. However, one has to consider that longer T couple more 
optimization periods, which is why a mono tonic behavior is not observed in our 

^Note that the results of Table 2 are not directly comparable with the values reported in Tables 1 
and 2 of [26], because different COP values have been used in the simulations of the two papers. 
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Table 2: Capacity (MW) of Reserve Products (Power Constraints) 


Duration 

Symmetry 

Winter 

Summer 

daily 

symmetric 

±105.9 

±89.6 

daily 

asymmetric 

±0/ - 196.9 

±45.3/ - 195.0 

hourly 

symmetric 

±109.0 

±92.6 

hourly 

asymmetric 

±0/ - 213.6 

±44.8/ - 198.4 


Table 3: Capacity (MW) of Reserve Products (Power & Energy Constr.) 


T(h) 

£(-) 

eT (h) 

day/win 

hour/win 

day/sum 

hour/sum 

1 

0.382 

0.382 

±109.4 

±110.0 

±92.5 

±97.6 

2 

0.300 

0.600 

±109.9 

±110.7 

±93.1 

±99.3 

4 

0.317 

1.268 

±109.0 

±110.2 

±92.6 

±99.5 

6 

0.290 

1.740 

±108.9 

±110.4 

±93.3 

±99.6 

8 

0.237 

1.896 

±108.9 

±111.0 

±94.6 

±101.5 

12 

0.203 

2.436 

±107.7 

±111.1 

±92.8 

±99.6 


simulation results. To gain deeper insight into the dependence of reserve capacities 
on T and e, we run simulations for two weeks in winter and summer with T € 
{1, 2,4, 6,8,12} hours and e varying from 0.05 to 0.5 with 0.05 increments, i.e., 60 
combinations for each season. We assume daily, symmetric reserves and simulate 
only Lvl, i.e., the reserve scheduling problem, whereas the building HVAC control 
is not considered. The reason is that many of the combinations of T and e are 
not achievable by the Chebyshev filter (20), and so Lv2 will likely be infeasible. 
However, our analysis provides intuition on the effect of T and e that could be 
useful for hlter design in a practical application. 

In Fig. 8(a), we show the total reserve capacities for each of the simulated 
cases in winter. Similar results are obtained for summer, but are omitted here due 
to space limitations. The dependence of reserve capacities on T and e demonstrates 
a clear pattern: increasing any of the two parameters reduces the reserve capacity. 
Note that the capacity is more sensitive to e than to T. To better illustrate this, 
we present the results of Fig. 8(a) based on the product eT in Fig. 8(b). As ex¬ 
pected, increasing sT generally decreases the reserve capacity. The same sT can 
be obtained by different (T, e) pairs: for example, both (8 h, 0.25) and (4 h, 0.5) 
obtain eT = 2, but the first achieves a capacity 96.72 MW, whereas the second 
achieves 93.61 MW. In this case, the capacity is more sensitive to e than to T. We 
compared all cases in winter and summer with the same eT and found out that in 
70% of them smaller e is preferable to smaller T. This means that buildings can 
cope easier with signals that are significantly energy constrained over long periods 
than signals that are moderately constrained over shorter periods. 
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7 Concluding Remarks 


In this paper, we proposed a new framework based on robust optimization and MPC 
for scheduling and provision of secondary frequency control (SFC) reserves by the 
HVAC systems of commercial building aggregations. The framework incorporates 
tractable methods to account for energy-constrained SFC signals, and relies on 
decentralized reserve provision to keep real-time communication requirements low 
and preserve privacy. We also presented how the framework can be used to estimate 
the SFC reserve potential from commercial buildings. 

Our analysis was based on four main assumptions: (a) there is no plant-model 
mismatch; (b) the predictions of weather and occupancy are perfect; (c) all building 
states can be measured; and (d) the reaction of heating/cooling devices is fast and 
does not cause any wear. Therefore, the reported results provide an upper bound 
on the amount of reserves from buildings. For a real implementation, additional 
care must be taken for (a)-(d): accounting for modeling and weather/occupancy 
prediction errors, use of state estimators, and modeling of the fast dynamics of 
heating/cooling devices. If multi-zone building models with hundreds of states are 
available, model reduction techniques [10] can be used to reduce the optimization 
problem’s size. The reserve scheduling problem considered capacity payments, but 
neglected revenues from reserve energy utilization. Incorporating the latter in the 
framework is possible if SFC signal scenarios can be generated based on histori¬ 
cal data, and is expected to reduce the necessary capacity payments. Additionally, 
comfort constraints can be relaxed as chance constraints allowing comfort zone 
violations with a small probability, which is typical for building climate control, 
while keeping HVAC input constraints robust. Such combination of robust and 
chance-constrained optimization is likely to increase reserve capacities. In the fu¬ 
ture, we plan to include these aspects in the framework, implement and test it on a 
real building. 

Overall, our results show that significant amounts of SFC reserves can be reli¬ 
ably offered by an aggregation of ~100 commercial buildings without loss of oc¬ 
cupant comfort. We found that with traditional unconstrained SFC signals asym¬ 
metric reserves are preferable for buildings, that energy-constrained SFC signals 
reduce the necessary capacity payments and increase reserves by up to ~10% com¬ 
pared to traditional SFC signals, and that reducing the duration of reserve products 
from 1 day to 1 hour increases reserves by up to ~9%. 
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